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(57) Abstract: The resolution of text rendered on a display device having sub-pixel elements (1660), such as an RGB LCTD for 
example, and in particular, on a display device having horizontal striping (650) is enhanced by (i) overscaling (or oversampling) 
(806) character outline information in the vertical (or Y) direction (1 140), and (ii) filtering displaced information from the overscaled 
(or oversampled) (806) character outline information. Metrics associated with character outline information may be appropriately 
adjusted. The vertical (or Y) position (1 140) of the baseline of adjacent characters may be constrained by forcing the first pixel 
above the baseline to be composed of a full number N of scan conversion source samples, where N corresponds to an overscaling 
(or oversampling) (806) factor. Color value may be selectively filtered when the differences in the intensity of adjacent sub-pixel 
elements (1660) would otherwise be irritating to view. Finally, the gamma of the pixel values may be corrected so that the gamma of 
the display device is considered and so that intensity values of sub-pixel elements (1660) fall within a range of intensities in which 
gamma correction (737) is more useful. 
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Data Structures For Overscaling Or Oversampling CSiaracier In A System For Rendering Text On 
Horizontally Striped Displays 

5 

§ 1. BACKGROUND OF THE INVENTION 
§1.1 FIELD OF THE INVENTION 

10 The present invention concerns producing more legible text on video displays, 

such as flat panel video monitors including liquid crystal display (or LCD) video 
monitors for example^ having horizontal striping. 
§ 1.2 RELATED ART 

The present invention may be used in the context of flat panel video monitors, 

1 5 such as LCD video monitors for example, hi particular, the present invention may be 

used as a part of processing to produce more legible text on LCD video monitors 
having horizontal striping. 

Color display devices have become the principal display devices of choice for 
most computer users. Color is rendered on a display monitor by operating flie display 

20 monitor to emit light (such as a combination of red, green, and blue Ught for 

example), which results in one or more colors being perceived by the human eye. 
Although color video monitors in general, and LCD video monitors in particular, are 
known to those skilled in the art, Ihey are introduced below for the reader's 
convenience. In § 1.2.1 below, cathode ray tube (or CRT) video monitors are first 

25 introduced. Then, in § 1 .2.2 below, LCD video monitors are introduced. 

§ 1.2.1 CRT VIDEO MONITORS 
Cathode ray tube (CRT) display devices include a screen having phosphor 
coatings which may be applied as dots in a sequence. A different phosphor coating is 
normally associated with the generation of different colors, such as red, green, and 

30 blue for example. Consequently, repeated sequCTices of phosphor dots are defined on 
the screen of the video monitor. One or more electron guns generate electron beams 
which are swept, typically left to right and top. to bottom, across the screen. When a 
phosphor dot is irradiated by an electron beana it will glow thereby rendering its 
associated color, such as red, green and blue for example. 
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The tenn "pixel" is commonly used to refer to one spot in a group of spots, 
such as a rectangular grid of thousands of such spots for example. The spots are 
selectively activated to form an image on the display device. In most color CRTs, a 
single triad of red, green and blue phosphor dots caimot be uniquely selected. 
5 Consequently, the smallest possible pixel size Avill depend on the focus, alignment and 

bandwidth of the electron guns used to excite the phosphor dots. The light emitted 
jfrom one or more triads of red, green and blue phosphor dots, in various arrangements 
known for CRT displays, tend to blend together giving, at a distance, the appearance 
of a single colored light source. 
10 In color displays, the intensity of Hhe light emitted from the additive primary 

colors (such as red, green and blue for example) can be varied to achieve the 
appearance of almost any desired color pixeL Adding no color, that is, emitting no 
light, produces a black pixel. Adding 100 percent of all three (3) colors produces a 
white pixel. 

15 Having introduced color CRT video monitors, color LCD video monitors are 

now introduced in § 1 .2.2 below. 

§ 1.2.2 LCD VIDEO MONITORS 
Portable computing devices (also referred to generally as computing 
appliances or untethered computing appliances) often use liquid crystal displays 
20 (LCDs) or other flat panel display devices, instead of CRT displays. This is because 

flat panel displays tend to be smaller and lighter than CRT displays. In addition, flat 
panel displays are well suited for battery-powered applications since they typically 
consume less power than comparably sized CRT displays. 

Color LCD displays are examples of display devices which distinctly address 
25 pixel elemmts to represent each pixel of an image being displayed. Normally, each 

pixel element of a color LCD display includes three (3) non-square elements (also 
referred to as "sub-pixel elements" or "sub-pixel components"). More specifically, 
each pixel element may include adjacent red, green and blue (RGB) sub-pixel 
elements. Thus, a set of RGB sub-pixel elements together define a single pixel 
30 element. Some LCD displays may have non-square pixels and/or pixels which are 

defined by more than three (3) sub-pixel elements. 

Known LCD displays generally include a series of RGB sub-pixel elements 
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which are conimonly arranged to form stripes along the display. The RGB stripes 
normally run ttie entire length of the display in one direction. The resulting RG B 
stripes are sometimes referred to as "RGB striping. Many LCD monitors, used for 
computer applications, are wider than they are tall, and tend to have RGB vertical 
5 stripes. On the other hand, many LCD monitors used in untethered or handheld 

computing appliances are taller than they are wide, and tend to have RGB horizontal 
stripes. The present invention may be used when rendering text on monitors, such as 
LCD RGB monitors for example, which have horizontal striping. 

Figure 1 illustrates a known LCD screen 100 comprising pixels arranged in a 

10 plurality of rows (R1-R8) and columns (C1-C6). That is, a pixel is defined at each 

row-colunm intersection. Each pixel includes a red sub-pixel element, depicted with 
hatching, a green sub-pixel element, depicted with cross hatching, and a blue sub- 
pixel element, depicted with no hatching. Figure 2 illustrates the upper portion of the 
known display 100 in greater detail. Note how each pixel element, e.g., the (Rl, C6) 

15 pixel element, comprises three distinct sub-pixel elements or sub-pixel components; a 

red sub-pixel element 210, a green sub-pixel element 220 and a blue sub-pixel 
element 230. Each known sub-pixel element 210, 220, 230 is 1/3, or approximately 
1/3, the height of a pixel while being equal, or approximately equal, in width to the 
width of a pixel. Thus, when combined, flie three 1/3 height, full width, sub-pixel 

20 elements 210, 220, 230 define a single pixel element 

Referring back to Figure 1, one known arrangement of RGB pixel sub- 
components 210, 220, 230 define horizontal color stripes on the display 100. 
Accordingly, the airangement of 1/3 height color sub-pixel elements 210, 220, 230, in 
the known manner illustrated ia Figures 1 and 2, exhibit what is sometimes called 

25 "horizontal striping". 

Li known systems, the RGB sub-pixel elements are generally addressed and 
used as a group to generate a single colored pixel corresponding to a single sample of 
tiie image to be represented. More specifically, in known systems, luminous intensity 
values for all of the sub-pixel elements of a pixel element are generated firom a single 

30 sample of the image to be represented. For example, referring to Figure 3, an image 

section 30O is segmented into twelve (12) squares by the grid 310. Each square of the 
grid 310 defined by the segmented image section 300 represents an area of the image 
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section 300 which is to be represented by a single pixel element. In Figure 3, a 
hatched circle 320 is used to represent a single image sample from which luminous 
intensity values associated with the red, green, and blue sub-pixel elements 330, 332, 
and 334 of the associated pixel are generated. 
5 Having introduced the general structure and operation of known LCD 

displays, known techniques for rendering text on such LCD displays, as well as 
perceived shortcomings of such known techniques, are introduced in § 1.2.2.1 below. 

§ 1.2.2.1 RENDERING TEXT ON LCD DISPLAYS 
Apart from pure image or video information, LCD displays are often used for 

10 rendering textual information. For example, a personal information manager may be 
used to render contact information, such as a person's address, telephone number, fax 
number, and e-mail address for example, on an untethered computing device. 

The expression of textual information using font sets is introduced in § 
1.2.2.1.1 below. Then, the rendering of textual information using so-called pixel 

1 5 precision and perceived shortcomings of doing so are introduced in § 1 .2.2. 1 .2 below. 

§ 1.2.2.1.1 FONT SETS 
A "font" is a set of characters of the same typeface (such as Times Roman, 
Courier New, etc.), the same style (such as italic), the same weight (such as bold and, 
strictly speaking, the same size). Characters may include symbols, such as the 

20 "Parties MT", "Webdings", and "Wingdings" symbol groups found on the Word™ 

word processor from Microsoft Corporation of Redmond, Washington for example. 
A "typeface" is a specific named design of a set of printed characters (e.g., Helvetica 
Bold Oblique) that has a specified obliqueness (i.e,, degree of slant) and stoke weight 
(i.e., line thickness). Strictly speaking, a typeface is not the same as a font, which is a 

25 specific size of a specific typeface (such as 12-point Helvetica Bold Oblique). 

However, since some fonts are "scalable", the terms "font" and "typeface" may 
sometimes be used interchangeably. A "typeface family" is a group of related 
typefaces. For example, the Helvetica family may include Helvetica, Helvetica Bold, 
Helvetica Oblique and Helvetica Bold Oblique. 

30 Many modem computer systems use font outline technology, such as scalable 

fonts for example, to facilitate the rendering and display of text. TraeType fonts from 
Microsoft Corporation of Redmond, Washington are an example of such technology. 
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In such systems, various font sets, such as "Times New Roman," "Onyx," "Courier 
New," etc. for example, may be provided. The font set normally includes high 
resolution outline representation, such as a series of contours for example, for each 
character which may be displayed using the provided font set. The contours may be 
5 straight lines or curves for example. Curves may be defined by a series of points that 

describe second order Bezier-splines for example. The points defining a curve are 
t5q)ically numbered in consecutive order. The ordering of the points may be important 
For example, the character outline may be "filled" to the right of curves when the 
curves are followed in the direction of increasing point numbers. Thus the high 

10 resolution character outline representation may be defined by a set of points and 

mathematical formulas. The point locations may be described in "font units" for 
example. A "font unit" may be defined as the smallest measurable unit in an "em" 
square, which is an imaginary square that is used to size and align glyphs (a glyph can 
be thought of as a character). Figure 9 illustrates an "em" square 910 around a 

15 character outline 920 of the letter Q. Historically, an "em" was approximately equal 

to the width of a capital M. Further historically, glyphs could not extend beyond the 
em square. More generally, however, the dimensions of an "em" square are those of 
the full body height 940 of a font plus some extra spacing. This extra spacing was 
provided to prevent lines of text from colliding when typeset without extra leading 

20 was used. Further in general, portions of glyphs can extend outside of the em square. 

The coordinates of the points defining the lines and curves (or contours) may be 
positioned relative to a baseline 930 (Y coordinate = 0). The portion of the character 
outline 920 above the baseline 930 is referred to as tiie "ascent" 942 of the glyph. The 
portion of the character outline 920 below the baseline 930 is referred to as flie 

25 "decCTit" 944 of flie glyph. Note that in some languages, such as Japanese for 

example, the characters sit on the baseline, with no portion of the character extending 
below the baseline. 

The stored outline character representation normally does not represent space 
beyond the maximum horizontal and vertical boundaries of tihie character (also 
30 referred to as "whitespace" or "side bearings"). Therefore, the stored character outline 

portion of a character font is often referred to as a black body (or BB). A font 
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generator is a program for transforming character outlines into bitmaps of the style 
and size required by an application. Font generators (also referred to as "rasterizers") 
typically operate by scaling a character outline to a requested size and can often 
expand or compress the characters fliat they generate. 
5 In addition to stored black body character outline information, a character font 

normally includes black body size, black body positioning, and overall character 
width information. Black body size information is sometimes expressed in terms of 
the dimensions of a bounding box used to define the vertical and horizontal borders of 
the black body. 

10 Certain terms used to define a character are now defined with reference to 

Figure 4, which illustrates character outlines of the letters A and I 400. Box 408 is a 
bounding box which defines the size of the black body 407 of the character (A). The 
total width of the character (A), including white space to be associated with the 
character (A), is denoted by an advance width (or AW) value 402. The advance width 

15 typically starts to a point left of the bounding box 408. This point 404 is referred to as 

the left side bearing point (or LSBP). The left side bearing point 404 defines the 
horizontal starting point for positioning the character (A) relative to a current display 
position. The horizontal distance 410 between the left end of the bounding box 408 
and the left side bearing point 404 is referred to as the left side bearing (or LSB). The 

20 left side bearing 410 indicates the amoimt of white space to be placed between the left 

end of the bounding box 408 of a current character (A) and the ri^t side bearing 
point of the preceding character (not shown). The point 406 to the right of the 
bounding box 408 at the end of the advance width 402 is referred to as the right side 
bearing point (or RSBP). The right side bearing point 406 defines the end of the 

25 current character (A) and the point at which the left side bearing point 404' of the next 

character (I) should be positioned. The horizontal distance 412 between the right end 
of the bounding box 408 and tfie right side bearing point 406 is referred to as flie right 
side bearing (or RSB). The right side bearing 412 indicates the amount of white space 
to be placed between the right end of the bounding box 408 of a current character (A) 

30 and the left side bearing point 404' of the next character (I). Note that the left and 

right side bearings may have zero (0) or negative values. Note also fliat in characters 
used in Japanese and other Far Eastem languages, metrics analogous to advance 
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width, left side bearing and right side bearing - namely, advance height (AH), top 

side bearing (TSB)and bottom side bearing (BSB) - may be used. 

As discussed above, a scalable font file normally includes black body size, 

black body positioning, and overall character width information for each supported 

5 character. The black body size information may include horizontal and vertical size 

information expressed in the form of bounding box 408 dimensions The black body 

positioning information may expressed as a left side bearing value 410. Overall 

character width information may be expressed as an advance width 402. 

§1.2.2.1.2 RENDERING TEXT TO PIXEL 
10 PRECISION 

Recall that font generators convert a black body character oufline into a 

bitmap. This conversion may consider the point size of the font to be rendered, and 
the resolution (e.g., dots per inch, pixels per inch, etc.) of the device (e.g., a video 
display, a printer, etc.), which will ultimately render the text. Most computer systems 

15 force the starting and ending points (Recall, for example, the left side bearing points 

and the right side bearing points, respectively) of characters to be rendered to be 
positioned on pixel boundaries. In addition, such computer systems usually force or 
convert the black body width and the left side bearing to be integer multiples if the 
pixel size In known implementations, these constraints are enforced by (i) scaling 

20 the size and positioning information included in a character fonts as a function of the 

point size and device resolution as just described above, and (ii) then rounding Hie 
size and positioning values to integer multiples of the pixel size used in the particular 
display device. Using pixel size units as the minimum (or "atomic") distance unit 
produces what is called "pixel precision" since the values are accurate to the size of 

25 one (1) pixel. 

Rounding size and positioning values of character fonts to pixel precision 
introduces changes, or errors, into displayed images. Each of these errors may be up 
to 1/2 a pixel in size (assuming that values less than 1/2 a pixel are rounded down and 
values greater than or equal to 1/2 a pixel are rounded up). Thus, the overall width of 

30 a character may be less precise than desired since the character's AW is (may be) 

rounded. In addition, the positioning of a character's black body within the total 
horizontal space allocated to that character may be sub-optimal since the left side 
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bearing is (may be) rounded. At small point sizes, the changes introduced by 
rounding using pixel precision can be significant 
§ 1.2.3 UNMET NEEDS 
In view of the errors introduced when rounding character values to pixel 
5 precision as introduced in § 1.2.2.1.2 above; methods and apparatus to improve text 

resolution are needed. The improvements to the legibility and perceived quality of 
text should work on displays, such as RGB LCDs for example, with horizontal 
striping, as well as those with vertical striping. 
§ 2 SUMMARY OF THE B>rVENTION 

10 The present invention increases the resolution of text rendered on a display 

device having sub-pixel elements, such as an RGB LCD for example, and in 
particular, on a display device having horizontal striping. The present invention may 
do so by (i) overscaling (or oversampling) character outline information in the vertical 
(or Y) direction and (ii) filtering (e.g., averaging) displaced (either overlapping, 

15 immediately adjacent, or spaced) scan conversion source samples firom the overscaled 

(or oversampled) character outline information. 

The present invention may also appropriately adjust metrics associated with 
the character outline information (such as left side bearing, advance width, vertical 
character size, ascent, descent, etc.). 

20 The present invention may also constrain the vertical (or Y) position of the 

baseline of adjacent characters by forcing flie first pfacel above tiie baseline to be 
composed of a full number N of scan conversion source samples; where N 
corresponds to an overscaling (or oversampling) factor. This prevents "jumping" or 
"bouncing" baselines. 

25 The present invention may also convert groups of scan conversion source 

samples into packed pixel index values. 

The present invention may also selectively filter color Values when the 
differences in the intensity of adjacent sub-pixel elements would otherwise be 
irritating to view. 

30 Finally, the present invention may correct the gamma of the pixel values (or to 

achieve an effect similar to gamma correction) so that the gamma of the display 
device is considered and so that intensity values of sub-pixel elements fall within a 
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range of intensities in which gamma collection is more useful. 
§ 3 BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 illustrates a known arrangement of sub-pixel elements of an LCD 
display having horizontal striping. 
5 Figure 2 illustrates a portion of Figure 1 in greater detail. 

Figure 3 illustrates a known image sampling operation. 

Figure 4 illustrates known ways of representing character information. 

Figure 5A is a block diagram of a computer system which may be used to 
implement at least certain aspects of the present invention. Figure 5B is a high level 
10 block diagram of a machine which may be used to implement at least certain aspects 

of flie present invention. 

Figure 6 illustrates an image sampling technique with which ihc present 
invention may be used. 

Figure 7 is a diagram of high level processes of an environment in which at 
1 5 least certain aspects of the present invention may operate. 

Figure 8 is a diagram of graphics display interface processes of an 
environment in which at least certain aspects of the present invention may operate. 

Figure 9 illustrates certain typographic terms which are used when describing 
certain aspects of the present invention. 
20 Figure 10 is a high level flow diagram of a first method for effecting an 

overscaling or oversampling process. 

Figure 1 1 is an example which illustrates the operation of the method depicted 
in Figure 10. 

Figure 12 is a high level flow diagram of a second method for effecting an 
25 overscaling or oversampling process. 

Figure 13 is an example which illustrates the operation of the method depicted 
in Figure 12. 

Figure 14 is a high level flow diagram of a method for effecting a hinting 
process. 

30 Figures 15A and 15B are examples which illustrate the operation of the 

hinting method of Figure 14. 

Figure 16 is a high level flow diagram of a first method for effecting a scan 
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conversion process. 

Figure 17 is a high level flow diagram of a second method for effecting a scan 
conversion process. 

Figures 18A and 18B illustrate the usefulness of zero padding steps in the scan 
5 conversion methods of Figures 1 6 and 1 7 , 

Figurel9 is an example which illustrates an exemplary scan conversion 

process. 

Figures 20A and 20B illustrate the storage and retrieval of scan conversion 
source samples (or more generally, information). 
10 Figure 21 is an exemplary data stracture which may be used to store glyph 

information in a glyph cache. 

Figure 22 is a high level flow diagram of an exemplary method for effecting a 
display driver management process. 

Figure 23 is a higji level flow diagram of an exemplary method for effecting a 
1 5 color compensation (or color filtering) process. 

Figure 24 is a high level flow diagram of an exemplary method for effecting a 
gamma correction method. 
§4 DETAILED DESCRIPTION 

The present invention concerns novel methods, apparatus and data structures 
20 used to increase the resolution of fonts to be rendered on displays, such as RGB LCD 
displays for example, having horizontal striping. The following description is 
presented to enable one skilled iq the art to make and use the invention, and is 
provided in the context of a particular application and its requirements. Various 
modifications to the disclosed embodiments will be apparent to those skilled in the 
25 art, and the general principles set forth below may be applied to other embodiments 

and applications. Thus, the present invention is not intended to be limited to the 
embodiments shown. 

The methods, apparatus and data structures of the present invention are 
described in the context of a system for improving the readability of text on flat panel 
30 screens. In § 4.1 functions which may be performed by the present invention are 

introduced in § 4.2, exemplary processes, methods and data structures for performing 
the present invention are described. Throughout § 4.2, examples which illustrate 
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operations and intermediate data structures of exemplary embodiments of the present 
invention are provided. Finally, concluding remarks about the present inventions are 
presented in § 4.3. 

§ 4.1 FUNCTIONS OF THE PRESENT INVENTION 
5 The present invention functions to increase the resolution of text rendered on a 

display device having sub-pixel elements, such as an RGB LCD for example, and in 
particular, on a display device having horizontal striping. The present invention may 
do so by (i) overscaling (or oversampling) character outline information in the vertical 
(or Y) direction, and (ii) filtering (e.g., averaging) displaced (either overlapping, 

10 immediately adjacent, or spaced) scan conversion source samples from the overscaled 

(or oversampled) character outline information. 

The present invention may also function to appropriately adjust metrics 
associated with the character outline information (such as left side bearing, advance 
width, vertical character size, ascent, descent, etc.). 

15 The present invention may also function to constrain the vertical (or Y) 

position of the baseline of adjacent characters by forcing the first pixel above the 
baseline to be composed of a fiill number N of scan conversion source samples, where 
N corresponds to an overscaling (or oversampling) factor. 

The present invention may also function to convert groups of scan conversion 

20 source samples into packed pixel index values. Although, in the following, the scan 

conversion process is described as operating on "scan conversion source samples, the 
scan conversion process, as well as the overscaling (or oversampling) and hinting 
processes may be analog operations operating on analog information rather than 
discrete samples. 

25 The present invention may also function to selectively filter color values when 

the differences in the intensity of adjacent sub-pixel elements would otherwise be 
irritating toview. 

Finally, the present invention may function to correct the gamma of the pixel 
values so that the gamma of the display device is considered and so that intensity 
30 values of sub-pixel elements fall within a range of intensities in which gamma 

correction is more useful. 
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§ 4.2 EXEMPLARY APPARATUS, PROCESSES, METHODS, 

AND DATA STRUCTURES FOR PERFORMING VARIOUS 
ASPECTS OF THE PRESENT INVENTION 

5 Exemplary methods, apparatus and data structures which may be used to effect 

various aspects of the present invention are described in the context of a system for 
improving the readability of text on flat panel screens having horizontal striping (also 
referred to as "text enhancement system"). An overview of this system is presented in 
§ 4.2.2 below. Before that, however, exemplary apparatus which may be used to 

10 effect at least some aspects of the present invention, as well as the text enhancement 

system, are described in § 4.2.1 below. 

§ 4.2.1 EXEMPLARY APPARATUS 
Figure 5A and the following discussion provide a brief, general description of 
an exemplary apparatus in which at least some aspects of the present invention may 

15 be implemented. Various methods of the present invention will be described in the 

general context of computer-executable instructions, such as program modules and/or 
routines for example, being executed by a computing device such as a personal 
computer. Other aspects of the invention will be described in terms of physical 
hardware such as display device components and display screens for example. 

20 Naturally, the methods of the present invention may be effected by apparatus 

other than those described. Program modules may include routines, programs, 
objects, components, data structures (e.g., look-up tables, etc.) that perform task(s) or 
implement particular abstract data types. Moreover, those skilled in the art will 
appreciate that at least some aspects of the present invention may be practiced with 

25 other configurations, including hand held devices, multiprocessor systems, 
microprocessor-based or programmable consumer electronics, network computers, 
minicomputers, set top boxes, mainframe computers, displays used in, e.g., 
automotive, aeronautical, industrial applications, and the like. At least some aspects 
of the present invention may also be practiced in distributed computing environments 

30 where tasks are performed by remote processing devices linked through a 
communications network. In a distributed computing environment, program modules 
may be located in local and/or remote memory storage devices. 

Figure 5A is a block diagram of an exemplary apparatus 500 which may be 
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used to implement at least some aspects of fee present invention. A personal 
computer 520 may include a processing unit 521, a system memory 522, and system 
bus 523 that couples various system components including the system memory 522 to 
the processing unit 521. The system bus 523 may be any of several lypes of bus 
5 structures including a memory bus or memory controller, a peripheral bus, and a local 

bus using any of a variety of bus architectures. The system 522 memory may include 
read only memory (ROM) 524 and/or random access memory (RAM) 525. A basic 
input/output system 526 (BIOS), including basic routines that help to transfer 
information between elements within the personal computer 520, such as during start- 

10 up, may be stored in ROM 524. The personal computer 520 may also include a hard 

disk drive 527 for reading from and writing to a hard disk, (not shown), a magnetic 
disk drive 528 for reading from or writing to a (e.g., removable) magnetic disk 529, 
and an optical disk drive 530 for reading from or writing to a removable (magneto) 
optical disk 531 such as a conq)act disk or other (mag?ieto) optical media. The hard 

15 disk drive 527, magnetic disk drive 528, and (magneto) optical disk drive 530 may be 

coupled with the system bus 523 by a hard disk drive interface 532, a magnetic disk 
drive interface 533, and a (magneto) optical drive interface 534, respectively. The 
drives and their associated storage media provide nonvolatile storage of machine 
readable instructions, data structures, program modules and other data for the personal 

20 computer 520. Although flie exemplary envirormient described herein employs a hard 

disk, a removable magnetic disk 529 and a removable optical disk 531, those skilled 
in the art will appreciate that other types of storage media, such as magnetic cassettes, 
flash memory cards, digital video disks, Bernoulli cartridges, random access 
memories (RAMs), read only memories (ROM), and the like, may be used instead of, 

25 or in addition to, the storage devices introduced above. 

A number of program modules may be stored on the hard disk 523, magnetic 
disk 529, (magneto) optical disk 531, ROM 524 or RAM 525, such as an operating 
system 535, one or more application programs 536, other program modules 537, 
display driver 732 (described in § 4.2.2.2 below), and/or program data 538 for 

30 example. The RAM 525 can also be used for storing data used in rendering images 

for display as will be discussed below. A user may enter commands and information 
into the personal computer 520 through input devices, such as a keyboard 540 and 
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pointing device 542 for example. Other input devices (not shown) such as a 
microphone, joystick, game pad, satellite dish, scanner, or the like may also be 
included. These and other input devices are often connected to the processing unit 
521 through a serial port interface 546 coupled to flie system bus. However, input 
5 devices may be connected by other interfaces, such as a parallel port, a game port or a 

universal serial bus (USB). A monitor 547 or other type of display device may also 
be connected to the system bus 523 via an interface, such as a display adapter 548, for 
example. In addition to the monitor 547, the personal computer 520 may include other 
peripheral output devices (not shown), such as speakers and printers for example. 

10 The personal computer 520 may operate in a networked environment which 

defines logical connections to one or more remote computers, such as a remote 
computer 549. The remote computer 549 may be another personal computer, a server, 
a router, a network PC, a peer device or other common network node, and may 
include many or all of the elements described above relative to the personal computer 

15 520. The logical connections depicted in Figure 5 A include a local area network 

(LAN) 551 and a wide area network (WAN) 552 (such as an intranet and the Internet 
for example). 

When used in a LAN, the personal computer 520 may be connected to the 
LAN 551 through a network interface adapter card (or *TSfIC") 553. When used in a 

20 WAN, such as the Internet, the personal computer 520 may include a modem 554 or 

other means for establishing communications over the wide area network 552. The 
modem 554, which may be internal or extemal, may be connected to the system bus 
523 via the serial port interface 546. In a networked environment, at least some of the 
program modules depicted relative to the personal computer 520 may be stored in the 

25 remote memory storage device. The network connections shown are exemplary and 

olher means of establishing a conamunications link between the computers may be 
used. 

Figure 5B is a more general machine 500* which may effect at least some 
aspects of the present invention. The machine 500' basically includes a processor(s) 
30 502, an input/output interface unit(s) 504, a storage device(s) 506, and a system bus or 

network 508 for facilitating data and control communications among the coupled 
elements. The processor(s) 502 may execute machine-executable instructions to 
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ef feet one or more aspects of tihe present invention. At least a portion of the machine 
executable instructions and data structures may be stored (temporarily or more 
permanently) on the storage devices 506 and/or may be received from an external 
source via an input interface unit 504. 
5 Having described exemplary apparatus which may be used to effect at least 

some aspects of the present invention, an overview of the text enhancement system is 
now presented in § 4.2.2 below. 

§ 4.2.2 TEXT ENHANCEMENT SYSTEM 
Recall from Figure 3, described in § 1.2.2 above, that most conventional 

10 systems treat pixels as individual units into which a corresponding portion of an 

image can be mapped. Accordingly, in the case of conventional systems, the same 
portion of an image, e.g., a pixel element sized portion, is used to determine flie 
luminous intensity values to be used with each of the RGB sub-pixel elements of a 
pixel element into which a portion of the scaled image is mapped. 

15 In the case of scaling fonts, the font unit coordinates used to define tiie 

position of points defining contours of a character outline were scaled to device 
specific pixel coordinates. That is, when the resolution of tiie em square is used to 
define a character outline, before that character can be displayed, it must be scaled to 
reflect the size, transformation and the characteristics of the output device on which it 

20 is to be rendered. The scaled outline describes the character outline in units that 

reflect the absolute unit of measurement used to measure pbcels of the output device, 
rather than the relative system of measurement of font units per em. Specifically, in 
the past, values in the em square were converted to values in the pixel coordinate 
system in accordance with the following formula: 

25 

size in pixels = (1) 
character outline size • point size • output device resolution 
72 points per inch • number of font units per em 

30 where character size is in font units, and output device resolution is in pixels/inch. 

The resolution of the output device may be specified by the number of dots or 
pixels per inch (dpi). For example, a VGA Video monitor may be treated as a 96 dpi 
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device, a laser printer may be treated as a 300 dpi device, an EGA Video monitor may 
be treated as a 96 dpi device in the horizontal (X) direction, but a 72 dpi device in the 
vertical (Y) direction. The font units per em may (but need not) be chosen to be a 
power of two (2), such as 2048 (=2^ ^) for example. 
5 . . In the text enhancement system of the present invention, the image is 

overscaled or oversampled, and in particular, may be overscaled or oversampled in 
the vertical (or Y) direction. The RGB sub-pixel elements of a pixel are treated as 
independent luminous intensity elements into which a different portion of the 
overscaled or oversampled image can be mapped. This overscaling or oversampling 

10 operation is described in more detail in § 4.2.2.1 .1 .1 below. 

Figure 7 is a high level diagram of processes which may be performed by the 
text enhancement system. As shown in Figure 7, an application process 710, such as a 
word processor or contact manager for example, may request that text be displayed 
and may specify a point size for the text. Althou^ not shown in Figure 71 flie 

15 application process 710 may also request a font name, background and foreground 

colors and a screen location at which the text is to be rendered. The text and, if 
applicable, the point size, are provided to a graphics display interface (or GDI) 
process (or more generally, a graphics display interface) 722. The GDI process 722 
uses display information 72A (which may include such display resolution information 

20 as pixels per inch on flie display) and character information 728 (which may be a 

character outline information which may be r^resented as points defining a sequence 
of contours such as lines and curves, advance widft information and left side bearing 
information) to generate glyphs (or to access cached glyphs which have already been 
generated). Glyphs may include a bitmap of a scaled character outline (or a bounding 

25 box 408 containing black body 407 information), advance widtfi 402 information, and 

left side bearing 410 infomiation. Each of Ihe bits of the bitmap may have associated 
red, green and blue luminous intensity values. As will be described below, these 
values may be combined into a single, 8-bit for example, value which may be referred 
to as a "packed pixel value." The graphics display interface process 722 is described 

30 in more detail in § 4.2.2.1 below. The graphics display interface process 722, the 

display information 724, and the glyph cache 726 may be a part of, and effected by, 
an operating system 535', such as the Windows® CE or Windows NT® operating 



BNSDOCID: <WO_0201546A1J_> 



wo 02/01546 PCT/USOO/17524 



-17- 

systems (from Microsoft Corporation of Redmond, Washington) for example. 

Glyphs, either from the glyph cache 726 or from the graphics display interface 
process 722, are then provided to a display driver management process (or more 
generally, a display driver manager) 735. The display drivCT management process 
5 735 may he a part of a display (or video) driver 732. Typically, a display driver 732 

may be software which permits a computer operating system to commmiicate with a 
particular video display. Basically, the display driver management process 735 may 
invoke a color compensation (or color filtering) process 736, a gamma correction 
process 737 and a color palette selection process 738. These processes 735, 736, 737, 

10 738 serve to convert the character glyph information into the actual RGB pixel sub- 

component luminous intensity values. One or more of the processes 736, 737, 738 
may be effected by a set of pre-computed look-up tables which may be used to 
perform a plurality of image processing operations. The display driver management 
process 735 receives, as input, glyphs and display information 724'. The display 

1 5 information 724* may include, for example, foreground/background color information, 

a gamma value of the display device 547, color palette information and pixel value 
format information. The display information 724' may be used to select one of the 
look-up tables included in the set of look up tables to be used. 

The processes which may be perfomied in fihe display driver are described in 

20 more detail in § 4.2.2.2 below. 

The processed pixel values may then be forwarded as video frame part(s) 
along with screen (and perhaps window) positioning information (e.g., from the 
application process 710 and/or operating system 535'), to a display (video) adapter 
548'. A display adapter 548' may include electronic components that generate a video 

25 signal sent to the display 547. A frame buffer process 740 may be used to store the 

received video frame part(s) in a screen frame buffer 745 of the display adapter 548. 
Using the screen frame buffer 745 allows a single image of, e.g., a text string, to be 
generated from glyphs representing several different characters. The video frame(s) 
from the screen frame buffer 745 is then provided to a display adaptation process 750 

30 which adapts the video for a particular display device. The display adaptation process 

750 may also be effected by the display adapter 548'. 

Finally, the adapted video is presented to the display device 547, such as an 
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LCD display for example, for rendering. 

Having provided an overview of a text enhancement system, the graphics 
display interface process 722 is now described in more detail in § 4.2.2.1 below. The 
processes which may be performed by the display driver are then described in more 
5 detail in § 4.2.2.2 below. 

§ 4.2.2-1 GRAPHICS DISPLAY INTERFACE 
Figure 8 illustrates processes that may be performed by a graphics display 
interface (or GDI) process 722, as well as data that may be used by the GDI process 
722. As shown in Figure 8, the GDJ process 722 may include a glyph cache 

10 management process (or more generally, a glyph cache manager) 802 which accepts 
text, or more specifically, requests to display text, 820. The request may mclude the 
point size of the text The glyph cache management process 802 forwards this request 
to the glyph cache 726. If the glyph cache 726 includes the glyph corresponding to 
the requested text character, it provides it for downstream processing If, on the other 

1 5 hand, the glyph cache 726 does not have the glyph corresponding to the requested text 

character, it so informs the glyph cache management process 802 which, in turn, 
submits a request to generate the needed glyph to the type rasterization process (or 
more generally, a typo rasterizer) 804. Basically, a type rasterization process 804 may 
be effected by hardware and/or software and converts a character outline (which may, 

20 recall include points which define contours such as lines and curves based on 
mathematical formulas) into a raster (fliat is, a bitaiapped) image. Each pixel of the 
bitmap image may have a color value and a brightness for example. A type 
rasterization process is described in § 4.2.2. 1 . 1 below. 

§ 4.2.2.1.1 RASTERIZER 

25 To reiterate, the type rasterization process 804 basically transforms character 

outlines into bitmapped images. The scale of the bitmap may be based on the point 
size of the font and the resolution (e.g., pixels per inch) of the display device 547. 
The text, font, and point size mformation may be obtained from the application 710, 
while the resolution of flie display device 547 may be obtained from a system 

30 configuration or display driver file or from monitor settings stored in memory 522 by 
the operating system 535. Ihe display information 724 may also include 
foreground/background color information, gamma values, color palette information 
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and/or display adapter/display device pixel value format information. To reiterate, 
this information may be provided from the graphics display interface 722 in response 
to a request from the application process 710. If, however, the background of the text 
requested is to be transparent (as opposed to Opaque), the background color 
5 information is what is being rendered on the display (such as a bitmap image or other 

text for example) and is provided from the display device 547 or the video frame 
buffer 745. 

Basically, the rasterization process may include two (2) or three (3) sub-steps 
or sub-processes. First, the character outline is overscaled (or oversampled) using an 
10 overscaling/oversampling process 806. This process is described in § 4.2J2.1,1.1 

below. Next, the overscaled/oversampled image generated by the 
overscaling/oversampling process 806 may be placed on a grid and have portions 
extended or shrunk using a hinting process 808. This process is described in § 

4.2.2.1.1.2 below. Then, displaced (e.g., immediately adjacent, overlapping, or 
15 spaced) samples of scan conversion source samples of the overscaled/oversampled 

(and optionally hinted) image are combined (e.g., filtered, averaged, etc.) by a scan 
conversion process 812 to generate values corresponding to the sub-pixel elements 
210, 220, 230 of the display 547. The scan conversion process 812 is described in § 

4.2.2.1.1.3 below. The resulting data stored in the glyph cache 726 is described in § 
20 4.2.2.1.1.4 below. 

§4^.2.1.1.1 SCALING/OVERSAMPLING 

Recall from § 4.2.2 above, that when scaling fonts in conventional systems 
such as TrueType™ from Microsoft Corporation of Redmond, Washington, the font 
unit coordinates used to define the position of points defining contours of a character 

25 outline were scaled to device specific pixel coordinates. That is, since the resolution 

of the em square was used to define a character outline, before that character could be 
displayed, it was scaled to reflect Ae size, transformation and the characteristics of 
the output device on which it was to be rendered. Recall that the scaled outline 
describes the character outline in units that reflect the absolute unit of measurement 

30 used to measure pixels of the output device, rather than the relative system of 

measurement of font units per em. Thus, recall that values in the em square were 
converted to values in the pixel coordinate system in accordance with the following 
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formula: 

size in pixels = 

character outline size • point size • output d evice resolution 
5 72 points per inch • number of font units per em 

where character size is in font units, and ou^ut device resolution is in pixels/inch. 

Recall that the resolution of an ou^ut device may be specified by the number 

of dots or pixels per mch (dpi). With Ae foregoing background in mind, in the text 
10 enhancement system of the present invention, flie image is overscaled or oversampled, 

and in particular, may be overscaled or oversampled in the vertical (or Y) direction. 

The RGB pixel sub-components of a pixel are treated as independent luminous 

intensity elements into which a different portion of the overscaled or oversampled 

image can be mapped. Thus, a higher degree of resolution than is possible with the 
15 known scan conversion techniques is provided. Accordingly, equation (1) discussed 

above may be modified to read: 

size in pixels = 

N • character outline size • point size • output devic e resolution 
20 72 points per inch • number of font units per em 

where character size is in font units, output device resolution is in pixels/inch, and 
where N is an oversealing or oversampling factor. 

25 In the case of RGB horizontally striped display devices, the oversealing or 

oversampling factor may be zero (0) in the X direction and three (3) In the Y 
direction. Such oversealing or oversampling factors would scale the character outline 
from font units to sub-pixel elements (Recall 210, 220, 230 of Figure 2.) In practice, it 
may be usefiil to further overscale or oversample. In this way, a number of scan 

30 conversion source samples may be used to derive the value of each sub-pixel 

component For example, if the oversealing or oversampling factor is nine (9) in the 
Y direction, three (3) scan conversion source samples may be used (e.g., via an 
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averaging operation) to define the intensity of a red sub-pixel element of a pixel, 
another three (3) scan conversion source samples may be used to define the intensity 
of a green sub-pixel element of the pixel, and the final Ihree (3) scan conversion 
source samples may be used to define ttie intensity of a blue sub-pixel element of the 
5 pixel. Alternative sampling and filtering techniques are possible. For example, fee 

samples may be weighted such that more scan conversion source samples are used to 
define the green sub-pixel element and less scan conversion source samples are used 
to define the blue sub-pixel elemra^t. In one embodiment, the red sub-pixel element is 
allocated a weight of five (5) and is derived from five (5) scan conversion source 

10 samples, the green sub-pixel element is allocated a weight of nine (9) and is derived 

from nine (9) scan conversion source samples, and the blue sub-pixel element is 
allocated a weight of two (2) and is derived from two (2) scan conversion source 
samples, and overscaling (or oversampling) is performed at a rate of one (1) time in 
the X direction and sixteen (16) times in the Y direction. This is referred to as 

1 5 "weighted sampling" . 

The samples may include some overlapping scan conversion source samples 
such that some scan conversion source sample(s) may be used to determine more than 
one sub-pixel element. Alternatively, some scan conversion source sample(s) may be 
ignored. Similarly, alternative filtering techniques to averaging may be used. 

20 Figure 6 illustrates an exemplary scan conversion operation implemented in 

accordance with an exemplary text enhancement system. In the illustrated 
embodiment, different image samples 630, 632, 634 of the image 610 segmented by 
the grid 620 are used to generate the red, green and blue intensity values associated 
with corresponding portions 640, 642, 644 of the bitmap image 650 being generated. 

25 In the example illustrated in Figure 6, image samples for red and blue are displaced - 

1/3 and +1/3 of a pixel width in distance from the green sample, re^ectively. Thus, 
flie placement errors introduced when rounding to pixel precision described in § 
1.2.2.1.2, encountered with the known sampling/image representation method 
illustrated in Figure 3, are decreased to such an extent that any remaining placement 

30 errors are barely, if at all, perceptible. To obtain sub-pixel resolution, the rasterized 

character, i.e., the bitmap produced by the rasterization process is overscaled and/or 
oversampled, typically in the direction perpendicular to the striping of the display 
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device. Oversampling can be thought of as compressing the grid of samples while 
maintaining the image on which the grid is laid. On the other hand, overscaling can 
be thought of as maintaining the grid of samples while stretching the image on which 
the grid is laid. 

5 In general, the overscaling (or oversampling) process 806 may perform a non- 

square scaling (or sampling) based on the direction and/or number of sub-pixel 
elements included in each pixel element. In particular, the high resolution character 
information 728 (Recall that this information may mclude contours defined by a 
sequence of points which define lines and curves.) may be overscaled (or 

10 oversampled) in the direction perpendicular to the striping at a greater rate than in the 

direction of the striping. Thus, for example, when vertically striped displays are used 
as the device upon which data is to be displayed, scaling is performed in the 
horizontal (or X) direction at a rate that is greater than that performed in the vertical 
direction. On the other hand, when horizontally striped displays of flie type illustrated 

15 in Figure 1 are used as the device upon which data is to be displayed, (scaling is 

performed in the vertical (or Y) direction at a rate that is greater flian that performed 
in the horizontal direction. Such uneven scaling allows subsequent image processing 
operations to exploit the higher degree of resolution that can be achieved by using 
mdividual sub- pixel elements as independent luminous intensity sources in 

20 accordance with the present invention. Thus, in most cases, the overscaling (or 

oversampling) of characters or images is, but need not be, performed in the direction 
peipendicular to the stripmg at a rate which allows further dividing of fee red, green 
and blue stripes to thereby support a subsequent scan conversion operation. 

Afirst overscaling (or oversampling) technique will now be described with 

25 reference to Figures 10 and 11, while a second overscaling (or oversampling) 

technique will be described with reference to Figures 12 and 13. Figure 10 is a high 
level flow diagram of a first method 806' for effecting the overscaling (or 
oversainpling) process 806. Figure 1 1 illustrates an example of the operation of the 
method 806* of Figure 10. First, as shown in s^ 1010, the font vector graphics (e.g., 

30 the character outline), point size and display resolution are accepted. This 

information is denoted 1 1 10 in Figure 1 1 . Font metrics such as the left side bearing 
(Recall 410.), advance width (Recall 402.), ascait (Recall 942.) and descent (Recall 
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944.) may also be accepted. This infonnation is denoted 1112 and 1 1 14 in Figure 1 1 . 
As shown in step 1020, the overscale factor or oversample rate (Recall N of Equation 
2.) is accepted. Then, as shown in step 1030 the font vector graphics (e.g., the 
character outline) 1110 is rasterized based on the point size, display resolution and 
5 the overscale factors (or oversample rate) . As shown in the example of Figure 1 1, the 

X coordinate values of the character outline (in units of font units), as well as the 
advance width and left side bearing (also in units of font units) are scaled as shown in 
1 120 (Recall Equation 1 .) and rounded to the nearest integer pixel value. On the other 
hand, the Y coordinate values of the character outline (in units of font units), as well 

10 as ascent , descent, and other vertical font feature values (also in units of font units) 

are overscaled as shown in 1130 (Recall Equation 2.) and rounded to the nearest 
integer scan conversion source sample value. The resulting data 1 140 is the character 
outlined in units of pixels in the X direction and units of scan conversion source 
samples in flie Y direction. The method 806' is then left via RETURN node 1040. 

15 Figure 12 is a high level flow diagram of a second mefliod 806" for effecting 

the overscaling (or oversampling) process 806. Figure 13 illustrates an example of 
the operation of the mediod 806" of Figure 12. First, as shown in step 1210, the font 
vector graphics (e.g., the character outline), point size and display resolution are 
accepted. This information is denoted 1310 in Figure 13. Font metrics such as is the 

20 left side bearing and advance width may also be accepted. As shown in step 1220, the 

overscale factor or oversample rate (Recall N of equation 2.) is accepted. Then, as 
shown in decision step 1230, it is determined whether the sub-pixel elements of the 
display are arranged in the order R-G-B or B-G-R for example. If the sub-pixel 
elements are arranged in the order R-G-B, flie font vector graphics (e.g., the character 

25 outline) 1310 is rotated by 90 degrees, counterclockwise. Referring to Figure 13, this 

transformation may be effected by changing the original X coordinate values to new 
Y coordinate values and by inverting the original Y coordinate values to generate new 
X coordinate values as denoted by 1312. Processing then continues to step 1260. 
Returning to decision step 1230, if the sub-pixel element are arranged in the order B- 

30 G-R, the font vector graphics (e.g., the character outline 1310 is rotated by 90 degrees 

clockwise. This transformation may be effected by changing the original X 
coordinates to new Y coordinates and by changing the original Y coordinates to X 
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coordinates. Note that in the foregoing examples, it was assumed that there were no 
negative X values - that is, that the Y axis was to the left of the font vector graphics 
(e.g., 1310). In instances in which there may be negative X coordinate values, the X 
values are inverted to generate Y values in the case of a 90 degree clockwise rotation. 
^ 5 Processing then continues to step 1260. 

At step 1260, the rotated font vector graphics (e.g., the character outline) 1110 
is rasterized based on the point size, display resolution and the overscale factor (or 
oversample rate). As shown in the example of Figure 13, the new Y coordinate 
values of the character outline (in units of font units), as well as the advance width 

10 and left side bearing (also in units of font units) are scaled as shown in 1330 (Recall 

equation 1.). These values may flien be rounded to the nearest integer pixel value. 
On the other hand, the new X coordinate values of the character outline (in units of 
font units), as well as ascent and descent values (also in units of font units) are 
overscaled (or oversampled) as shown in 1320 (Recall equation 2.) and rounded to the 

15 nearest integer scan conversion source sample value. The resulting data 1340 is the 

character outUne in units of pixels in the new Y direction and units of scan conversion 
source samples in the new X direction. Returning to Figure 12, the method 806" is 
left via RETURN node 1 270. 

Although the first method 806' is easier to implement, the second method 806" 

20 provides certain data access advantages in certain embodiments, when accessing tiie 

data 1340 during a scan conversion process 812. These advantages are described in 
§4.2.2. 1 . 1 .3 below with reference to Figures 20A and 20B. 

Referring back to Figure 8, once the overscaling (or oversampling) process 
806 is performed, fiie optional hinting process 808 may be performed. This process 

25 808 is described in §4.2.2.1.1.2 below. 

§ 4.2.2.1.1.2 HINTING 

The purpose of hinting (also referred to as "instructing a glyph") is to ensure 
that critical characteristics of the original font design are preserved when the glyph is 
rendered at different sizes and on different devices Consistent stem weights, 
30 consistent "color" (that is, in this context, the balance of black and white on a page or 

screen), even spacing, and avoiding pixel dropout are common goals of hinting. In 
the past, uninstructed, or unhinted, fonts would generally produce good quality 
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results at sufficiently high resolutions and point sizes. However, for many fonts, 
legibility may become compromised at smaller point sizes on lower resolution 
displays. For example, at low resolutions, with few pixels available to describe the 
character shapes, features such as stem weights, crossbar widths and serif details can 
5 become irregular, or inconsistent, or even missed completely. Although the higher 

resolution afforded by the present invention improves legibility, hinting may still be 
useful. 

Basically, hinting may involve "grid placement" arid "grid fitting". Grid 
placement is used to align a scaled (or overscaled) character within a grid, that is used 

10 by a subsequent scan conversion operation, in a manner intended to optimize the 
accurate display of the character using the available sub-pixel elements Grid fitting 
involves-distorting character outlines 502 that the character better conforms to the 
shape of ttie grid. Grid fitting ensures that certain features of the glyphs are 
regularized. Since the outlines are only distorted at a specified number of smaller 

15 sizes, the contours of the fonts at high resolutions remain unchanged and undistorted. 

In grid placement, sub-pixel element boundaries may be treated as boundaries 
along which characters can, and should, be aligned or boundaries to which the outline 
of a character should be adjusted. 

In many cases, hinting involves aligning the left edge of a character stem with 

20 a left pixel or sub-pixel element boundary and aligning the bottom of tiiie character's 

base along a pixel component or sub-pixel element boundary. Experimental results 
have shown that in the case of vertical striping, characters with stems aligned so that 
the character stem has a blue or green left edge generally tend to be more legible than 
characters with stems aligned to have a red left edge. 

25 Accordingly, in at least some embodiments! when hinting characters to be 

displayed on a screen with vertical striping, blue or green left edges for stems are 
favored over red left edges as part of the hinting process. In the case of horizontal 
striping, characters aligned so that the bottom of character features in general, and 
especially horizontal character features (such as crossbars in the letters A and H and 

30 bottom features of the letters E and Z; for example), has a red-or blue bottom edge 

generally tend to be more legible than characters with bases aligned to have a green 
bottom edge. Accordingly, when hinting characters to be displayed on a screen with 
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horizontal striping, in at least some embodiments, red or blue bottom edges are 
favored over green bottom edges as part of the hinting process. 

Figure 14 is a high level flow diagram of an exemplary method 808* for 
effecting at least a part of a hinting process 808. Figures 15A and 15B illustrate the 

5 operation of the method 808' of Figure 14. First, as shown in step 1410, the 

overscaled or oversampled character bitmap is accepted. As just described above, if 
the bottom of the character feature is on a scan conversion source sample that will be 
scan converted to a green sub-pixel element, it should be shifted (or distorted) to scan 
conversion source samples to be scan converted to a blue or a red sub-pixel element, 

10 or to a scan conversion source sample adjacent to a scan conversion source sample to 

be scan converted to a blue or a red subrpixel element Therefore, as shown at 
decision step 1420, if the bottom of the character feature is not on a scan conversion 
source sample to be scan converted to a green sub-pixel element, the method 808' is 
left via RETURN node 1460. On the other hand, if tfie bottom of the character feature 

15 is on a scan conversion source sample to be scan converted to a green sub-pixel 

element, processing branches to decision step 1430 where it is detemiined whether or 
not the bottom of the character feature is closer to a scan conversion source sample to 
be scan converted to a red sub-pixel element or a scan conversion source sample to be 
scan converted to a blue sub-pixel element. In the former case, the character feature 

20 outline is shifted (or compressed) up so that its bottom is on a scan conversion source 

sample to be scan converted to a red sub-pixel element as shown in step 1440. In the 
latter case, the character feature outline is shifted (or stretched) down so fliat its 
bottom is on (or immediately adjacent to) a scan conversion source sample to be scan 
converted to a blue sub-pbcel element as shown in step 1450. In eilher case, the 

25 method 808' is left via RETURN node 808'. 

Figures ISA and 15B illustrate the operation of the method 808' of Figure 14 
on character outlines in an overscaled or oversampled character outline which is to be 
subject to a weighted scan conversion in which five (5) scan conversion source 
samples will be used to derive a red sub-pixel element, nine (9) scan conversion 

30 source samples will be used to derive a green sub-pixel element, and two (2) scan 

conversion source samples will be used to derive a blue sub-pbcel element In the 
example of Figure 15A, the bottom 1512 of the overscaled or oversampled character 
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feature outline 1510 is at a scan conversion source sample to be scan converted to a 
green sub- pixel element but is close to the scan conversion source samples to be scan 
converted to a blue sub-pixel element Accordingly, flie overscaled or oversampled 
character feature outline is shifted (or stretched) downward such that the bottom 1512' 
5 of the resulting overscaled or oversampled character feature outline 1510" is on the 

scan conversion source sample which is immediately adjacent to a scan conversion 
source sample to be scan converted to a blue sub-pixel element In the example of 
Figure 15B, the bottom 1522 of the overscaled or oversampled character feature 
outline 1520 is at a scan conversion source sample to be scan converted to a green 

10 sub-pixel element but is close to the scan conversion source samples to be scan 
converted to a red sub-pixel element Accordingly, the overscaled or oversampled 
character feature outline is shifted (or compressed) upward such that the bottom 
15221 of the resulting overscaled or oversampled character feature outline 1520* is on 
the scan conversion source sample to be scan converted to red sub-pixel element 

15 Other hinting iastructions, known to those skilled in the art, may also be 

carried out on the overscaled or oversampled character oufline. Note however, that 
the additional vertical resolution afforded by considering sub-pixel elements may 
make performing certain hinting instructions unnecessary. 

Once the hinting process 808 is completed, or if the hinting process 808 is not 

20 to be performed, once the overscaling (or oversampling) process 806 is complete, a 
scan conversions process 812 is performed. The scan conversion process is described 
in §4.2.2.1.1.3 below. 

§4.2.2.1.1.3 SCAN CONVERSION 
Basically, the scan conversion process 812 converts the overscaled (or 

25 oversampled) geometry representing a character into a bitmap image. Conventional 

scan conversion operations treat pixels as individual units into which a corresponding 
portion of the scaled image can be mapped. Accordingly, in conventional scan 
conversion operations, the same portion of an image is used to determine the 
luminous intensity values to be used with each of tfie red, green and blue sub-pixel 

30 elements of a pixel element into which a portion of the scaled image is mapped. 

Recall that Figure 3 illustrates an example of a known scan conversion process which 
involves sampling an image to be represented as a bitmap and generating luminous 
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intensity values from the sampled values. 

In tfie scan conversion process 812 of the text enhancement system, the red, 
green and blue sub-pixel elements of a pixel are treated as independent luminous 
intensity elements. Accordingly, each sub-pixel element is treated as a separate 

5 luminous intensity component into which a different portion of the overscaled (or 

oversampled) image can be mapped. By allowing different portions of a overscaled 
(or oversampled) image to be mapped into different sub-pixel element, a higher 
degree of resolution flian with the known scan conversion techniques is provided. 
Stated in another way, different portions of the overscaled (or oversampled) image are 

10 used to independently determine the luminous intensity vahies to be used with each 

sub-pixel element. Thus, ttie scan conversion process can be thought of as filtering 
(e.g., averaging) displaced samples. The displaced samples may be overlapping, one 
immediately adjacent to the next, and/or one spaced from the next 

Recall that Figure 6 illustrates an exemplary scan conversion process 812 

15 which may be used in the text enhancement system. In the illustrated embodiment, 

different image samples 630, 632, 634 of Ihe image 610 segmented by the grid 620 
are used to generate the red, green and blue intensity values associated with 
corresponding portions 640, 642, 644 of the bitmap image 650 being generated. 
Recall that in the example illustrated in Figure 6, image samples for red and blue are 

20 displaced -1/3 and +1/3 of a pixel height in distance from the green sample, 

respectively. 

Tlie scan conversion processes 812 generates red, green and blue (R, G, B) 

luminance intensity values for each pixel sub-component These values may be 

expressed in tihe form of separate, red, green and blue luminance intensity levels. 
25 Having provided a brief overview of the scan conversion process 812, two (2) 

exemplary methods for effecting the scan conversion process 812 are now described 

with reference to Figures 16 and 17. 

Figure 16 is a high level flow diagram of an e?cemplary method 812' for 

effecting the scan conversion process 812. As shown in step 1610, the hinted and 
30 overscaled (or oversampled) character outline bitmap is accepted. Similarly, as 

shown in step 1620, tiie overscaled (or oversampled) glyph metrics are also accepted. 

Then, as shown in step 1630, expected size glyph metrics are determined from the 
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overscaled (or oversampled) glyph metrics. More specifically, since some of the 
metrics (e.g., the ascent and descent) accepted by the scan conversion process 812 
have been oversampled by N (e.g., N=16), in the Y direction (Recall Figures 1 1 and 
13.), when converting these overscaled (or oversampled) glyph metrics into expected 
5 size (i.e., scaled to tihe particular output device on which flie text is to be rendered) 

glyph metrics, the ascent (also refenred to as the Y component of the left side bearing) 
and the body or size of the glyph (i.e., the ascent plus the absolute value of the 
descent) may be determined as follows: 

1 0 ascent = ceiling (overscaled ascent /N) (3) 

body height = ceiling (overscaled ascent/N) + 

I ceiling (overscaled descenl/N) | (4) 

15 where "ceiling" is an operator which rounds non-integer numbers up to the next 

greater integer. This step is used to ensure that there will be a complete pixel for scan 
conversion source samples of the overscaled (or oversampled) character outline 
bitmap. 

Next, as shown in step 1640, remainder scan conversion source samples in the 
20 ascent and descent of the character outline are zero padded. More specifically, if the 

number of scan conversion sowce samples in the ascent is not evenly divisible by the 
overscaling (or oversampling) factor N, then additional scan conversion source 
samples, with a value of zero (0), are added to the ascent of the character outline until 
the number of scan conversion source samples in the ascent is evenly divisible by the 
25 overscaling (or oversampling) factor N. Similarly, if the number of scan conversion 

source samples in the descent is not evenly divisible by the overscaling (or 
oversampling) factor N, then additional scan conversion source samples, with a value 
of zero (0), are added to the descent of the character outline until the nimiber of scan 
conversion source samples in the descent is evenly divisible by the overscaling (or 
30 oversampling) factor N. As will be illustrated later with reference to Figures 1 8A and 

18B, this step ensures fliat the baselines of adjacent characters do not "jump" or 
"bounce". Note that other techniques which are functionally equivalent to zero 
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padding may be used instead. Such functionally equivalent techniques may include, 
for example, having the scan conversion process access integer multiples of the 
overscaling factor (or oversampling rate) of scan conversion source samples above fte 
baseline and ignoring (using masking operations for example) scan conversion source 
samples above the ascent of the character outline. 

Next, as shown in step 1650, the sub-pixel element values are determined 
based on scan conversion source samples As discussed above, this determination 
may be made by filtering displaced samples. Figure 19 illustrates an example of a 
weighted scan conversion process. This exemplary scan conversion process is termed 
"weighted" since the intensity value of tfie red sub-pixel element is based on a sample 
of five (5) scan conversion source samples, the intensity value of the green sub-pixel 
element is based on a sample of nine (9) scan conversion source samples, and the 
intensity value of the blue sub-pixel element is based on a sample of two (2) scan 
conversion source samples. This weighting may be used since the human eye 
perceives light intensity from different color light sources at different rates. Green 
contributes approximately 60%, red approximately 30% and blue approximately 10% 
to the perceived luminance of a white pixel which results from having Ae red, green 
and blue sub-pixel elements set to their maximum luminous intensity output. Thus, 
when allocating resources, such as luminous intensity levels for example, more levels 
may be allocated to green than to blue or red. Similarly, more intensity levels may be 
allocated to red then to blue. However, in some embodiments, equal numbers of 
intensity levels are assiqned to red, green, and blue sub-pixel elements. The 
overscaling (or oversampling) factor in tiiis example was sixteen (1 6). 

In Figure 19, flie dashed line 1910 depicts a part of an ovCTScaled (or 
oversampled) character outlme. Reference number 1912 denotes an area within the 
character oudine 1910, while reference number 1914 denotes an area outside of the 
character oufline 1910. Figure 19 illustrates scan conversion source samples 
corresponding to two (2) pixels, havmg six (6) sub-pixel elements, of the display on 
which the character 1910 is to be rendered. In this example, the filtering operation 
simply adds the number of samples in which the center 1922 of the scan conversion 
source sample 1920 lies within or on flie overscaled (or oversampled) character 
outUne 1910. Alternatively, the number of scan conversion source samples which are 
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at least 50% within the character outline 1910 may be used. Notice that the topmost 
source sub-pixel has been zero padded so that the ascent of the character outline 1910 
is evenly divisible by sixteen (16). (Recall step 1640.) In the first set 1930a of scan 
conversion source samples, the red value 1932a is three (3), the green value 1934a is 
5 eight (8) and the blue value 1936a is zero (0). In the second set 1930b of scan 

conversion source samples, the red value 1932b is zero (0), tiie green value 1934b is 
zero (0), and flie blue value 1936b is two (2). 

Referring back to Figure 16, in optional step 1660, the sub-pixel element 
values are "packed". In an exemplary embodiment, the sub-pixel element values are 
10 packed into a single eight (8) bit value in accordance with the following expression: 

Packed Pixel Value 3 x (1 0 x red + green) + blue (S) 
Thus, for example, the packed pixel value corresponding the first set 1930a of scan 
conversion source samples is 1 14 (= 3 x (10 x 3 + 8) + 0) and the packed pixel value 
corresponding to the second set 1930b of scan conversion source samples is 2 (= 3 x 
15 (10 X 0 + 0) + 2). The packed pixel value will have a value between zero (0) 

(i.e,,when the red, green and blue values are all zero (0)) and 179 (i.e., when the red 
value is five (5), the green value is nine (9) and the blue value is two (2)). 

Next, in step 1670, the character bitmap and glyph metrics are stored in the 
glyph cache 726. An exemplary data stracture of the data stored in the glyph cache 
20 726 is described in § 4.2.2.1.1.4 below. The method 812' is then left via RETURN 

node 1680. 

Figure 17 is a high level flow diagram of an alternative method 812" for 
effecting a scan conversion process 812. The method 812" of Figure 17 may be used 
when the overscaling (or oversampling) method 806" of Figure 12 is used. Recall 

25 from steps 1240 and 1250 of Figure 12, as well as glyph 1314 of Figure 13, that the 

character outline 1310 was rotated by 90 degrees. Thus, in the method of claim 17, 
the scan converted glyph is rotated back as shown in st^ 1770. More specifically, in 
the case of a video display having sub-pixel elements arranged in the order R-G-B, 
the Y coordinates are mapped to final X coordinates, negative X coordinates are 

30 mapped to positive final Y coordinates, and positive X coordinates are mapped to 

negative final Y coordinates. Such coordinate mapping may be automatically effected 
by the manner in which scan conversion source samples are accessed (as will become 
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apparent in the description of Figure 20B below). Otherwise, the method 812" of 
Figure 17 is similar to that of Figure 16. 

As discussed in § 4.2.2.1.1.1 above, the overscaling (or oversampling) method 
806" of Figure 12 stores scan conversion source sample information in a way that may 
5 be easier to access by a scan conversion process 812, such as the scan conversion 

method 812" of Figure 17 than when overscaling (or oversampling) method 806' of 
Figure 10 stores scan conversion source sample information. Figures 20A and 20B 
illustrate this difference in the ease of accessing scan conversion source sample 
information by the scan conversion process 812. As shown in Figure 20A, scan 

10 conversion source sample information from the overscaled (or ov^sampled) character 

outline 1 140 may broken into a number of bytes, from left to right and top to bottom 
and stored as a series of bytes denoted by reference number 2010. Since the scan 
conversion process 812 is accessing a number (e.g. 16) of consecutive scan 
conversion source sanq)les in flie Y direction, it will have to, for example, access one 

15 (1) bit from byte 2000i,i' skip i bytes, access one (1) bit from byte 20002,i' etc. On tiie 

other hand, as shown in Figure 20B, scan conversion source sample information from 
the rotated and overscaled (or oversampled) character outline 1340 may be brokeai 
into a number of bytes from left to right and top to bottom and stored as a series of 
bytes denoted by reference number 2010\ However, in this case, since the scan 

20 conversion is accessing a number (e.g., 16) of consecutive bits in the X direction 

(which was originally the Y direction), it can merely access two (2) consecutive bytes 
(such as 2000i,r and 2000i^* for example. If fliere are scan conversion source 
samples correspondmg to a space between the two of the body 940 of the character 
outline and the em box 910 (Recall Figure 9.), an access method which accounts for 

25 such offsets may be used. 

Recall that in step 1640 of Figure 16 and step 1740 of Figure 17 that 
remainder scan conv^sion source samples in the ascent and descent of the character 
outlme are zero padded. More specifically, recall that if the number of-scan 
conversion source samples in flie ascent is not evenly divisible by the overscaling (or 

30 oversampling) factor N, then additional scan conversion source samples, with a value 

of zero (0), are added to the ascent of the character outline until the number of scan 
conversion source samples in fee ascent is evenly divisible by the overscaling (or 
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oversampling) factor N. Similarly, if the number of scan conversion source samples in 
the descent is not evenly divisible by the overscaling (or oversampling) factor N, then 
additional sub-pixel source samples, with a value of zero (0), are added to the descent 
of the character outline until the number of scan conversion source samples in the 
5 descent is evenly divisible by the overscaling (or oversampling) factor N. Figures 

18A and 18B serve to illustrate how these st^s prevent the baseline from "jumping'* 
or ''boimcing". 

In Figure 18A, it is assumed fliat source sample 1850a is the highest sub-pixel 
source sample of the overscaled (or oversampled) character outline. Reference 

10 number 1810b denotes the first 16 (where the overscaling or oversampling factor is 

16) scan conversion source sanqples above the baseline 1820 while reference number 
1810a denotes the last 16 scan conversion source samples above the baseline 1820. 
Without zero padding, the first set of samples will take 15 scan conversion source 
samples from the set 1810a and one (1) scan conversion source sample from the next 

15 set (not shown) As more sets of samples are processed by fhe scan conversion process 

812, this offset will propagate down such that a set of samples will take 15 scan 
conversion source samples from the set 1810 above the baseline 1820 and one (1) 
scan conversion source sample from flie first set below the baseline 1820. 
Effectively, the consequence of not zero padding the top set 1810a of scan conversion 

20 source samples is that fhe baseline 1820 will move down one scan conversion source 
sample. Zero padding fhe top set 1810a of the scan conversion source samples 
maintains the position of the baseline 1820. 

Refeiring now to Figure 18B, it is assumed that scan conversion source 
sample 1850c is the highest scan conversion source sample of fhe overscaled (or 

25 oversampled) character outiine. Reference number 181 Od denotes the first 16 (where 
the overscaling or oversampling factor is 16) scan conversion source samples above 
the baseline 1820 while reference number 1810c denotes fhe last 16 scan conversion 
source samples above fhe baseline 1820. Without zero padding, Hhet first set of 
samples will take one (1) scan conversion source sample from the set 1810c and 15 

30 scan conversion source samples from fhe next set (not shown). As more sets of 

samples are processed by fhe scan conversion process 812, this offset will propagate 
down such that a set of samples will take one (1) scan conversion source sample from 
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the set ISlOd above the baseline 1820 and 15 scan conversion source samples from 
the first set below the baseline 1820. Effectively, the consequence of not zero 
padding the top set 1 81 Oc of scan conversion source sample is that the baseline 1 820 
will move down 15 scan conversion source samples, zero-padding the top set 1810c 

5 of the scan conversion source saix5>les maintains the position of the baseline 1 820. As 

can be appreciated from a comparison of Figures 18A and 18B, without zero padding 
the scan conversion source samples in the topmost set of N (e.g., N=16) scan 
conversion source samples, the position of the baseline 1820 might move, or "jump" 
from one character to the next 

10 Having described the scan conversion process 812, aa exemplary data 

stracture for storing the resulting glyph and glyph metrics is described in § 4.2.2. LL4 
below. 

§ 4.2.2.1.1.4 EXEMPLARY PACKED 
PIXEL VALUE DATA STRUCTURE 

15 

In many systems, R, G and B luminance intensity values are specified, stored 
and processed as three (3) discrete quantities, each having a number of bits 
corresponding to the number used to specify sub-pixel element luminance intensity 
values to the display adapter 548 and/or display device 547. For example, many 

20 systems use 8 -bit quantities, each representing an R, G or B luminance intensity 

value. In such an implementation, the processing of R, G and B luminous intensity 
values requires the storage, processing and transfer of 24 bits per pixel. 

In the same devices (such asportable computers and hand held computing 
devices for example) where memory, processing, and even bus bandwidth are limited 

25 resources, using eight (8) bits to represent each R, G, B luminance intensity value 

throughout flie entire rendering process can significantly burden the available 
resources. To reduce the resources, including memory, required to process and store 
glyphs, separate R, G, and B luminous intensity level values may be converted, e.g., 
compressed, into a single number. (Recall steps 1660 and 1760 of Figure 16 and 

30 Figure 17, respectively, and their associated description in § 4.2.2.1.1.3 above.) To 

reiterate, this number is referred as a "packed pixel value" because it represents the 
packing of the R, G and B luminous intensity values associated, with a pixel, into a 
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single value. The range of numbers, e.g., range of packed pixel values, used to 
represent pixel R, G and B luminous intensity levels, is selected to be large enough so 
that each possible R, G, B luminous intensity level combination can be uniquely 
identified. Thus, the total number of packed pixel values, used to represent R, G and 

5 B luminous intensity level combinations, should be at least as large as the product of 

the total number of supported red intensity levels, the total number of supported green 
intensity levels, and the total number of supported blue intensity levels. Since it is 
often convenient to work with bytes, i.e., 8-bit quantities in terms of memory access, 
processmg, and data transfer operations, the product should be able to be specified as 

10 an 8-bit quantity or a multiple there of. In hand held computing devices, a single 

eight (SY bit per pixel representation of the product of the R, G and B luminance 
intensity values is particularly desirable because of the significant savings in terms of 
memory, etc. (as compared to embodiments which use eight (8) bits per sub-pbcel 
element luminous intensity value requiring a total of 24 bits per pixel). 

15 To limit the resource burden associated with rendering images generally, and 

text images in particular, the scan conversion process 812 may convert separate R, G 
and B luminous intensity values associated with a pixel into a packed pixel value. In 
such an embodiment, glyphs are represented, and stored using packed pixel values as 
opposed to, e.g., separate 8-bit R, G and B luminous intensity values. The packed 

20 pixel value representations may be converted into separate R, G, and B luminance 

values of the form used by the display device 547 before the luminous intensity values 
are supplied to the display adapter 548. 

Converting separate R, G and B lunoinous intensity levels into packed pixel 
values may be performed as part of, or as a post process to, the scan conversion 

25 process 812. (Recall steps 1660 and 1760 of Figures 16 and 17, respectively, 

described above.) A shift operation or arithmetic equation may be used to convert 
between separate R, G and B luminance intensity levels associated with a pixel and a 
packed pixel value. Such an operation will can produce a total of M (0 through M-1). 
distinct packed pixel value entries, where M is tiie total number of possible R, G and 

30 B luminous intensity level combinations that may be assigned to a pixel element A 

corresponding R, G and B luminous intensity level combination is associated with 
each packed pixel value The R luminous intensity values vary from 0 to RP-1 where 
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RP is the maximum possible number of red luminous intensity levels. The G 
luminous intensity values vary from 0 to GP-1 where GP is the maximum possible 
number of green luminous intensity levels. The B luminous Intensity values vary from 
0 to BP-1 where BP is the maximum possible number of blue luminous intensity 
5 levels. Alternatively, packed pixel values may be converted into separate R, G, B 

luminous intensity values using a look-up table by using the packed pixel value as an 
index into the look-up table and outputting the indiAddual R, G and B luminous 
intensity level entries associated with the packed pixel value. 

Recall that in the exemplary scan conversion processes 812' and 812" 

10 described above, overscaling (or oversampling) in the direction perpendicular to the 
RGB striping by a factor of sixteen (16) was supported - sbc (6) red luminous 
intensity levels were used, e.g., levels 0-5, ten (10) green luminous intensity levels 
were used, e.g., levels 0-9, and three (3) blue luminous intensity levels were used, 
e.g., levels 0-2. This results in a total of 180 (= 6 x 10 x 3) possible R, G and B 

15 luminous intensity level combinations. In such an embodiment N would equal 180 

and the look-up table would include packed pixel values 0-179. 

Note that the number of supported R, G, and B luminous intensity levels is 
usually a function of the number of scan conversion source samples used to determine 
the R, G and B luminous intensity levels during the scan conversion process 812. 

20 Note also that in the exemplary embodiment where 180 possible R, G, B luminance 
intensity level combinations are supported, each of flie packed pixel values 0-179 can 
be represented using an 8-bit quantity. This significantly lowers storage requirements 
as compared to embodiments where separate 8-bit values are used for a total of 24 bits 
per R, G, B combination. 

25 Figure 21 illustrates an example of information which may be stored in the 

glyph cache 726' by the scan conversion process 812. The glyph cache 726' may 
include a number of glyph files 21 10a. Each of the glyph files 21 10a may include a 
number of glyph metrics 2112a (such as left side bearing, advance width, ascent, 
descent, etc. for example) and a number of pixel records 2120. Each of the pixel 

30 records 2120 may include display screen pixel coordinates 2122 and a packed pixel 

value 2124. 

Having described the graphics display interface process 722, the display driver 
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723 and its associated processes are described in § 4.2.2.2 below. 

§ 4.2.2.2 DISPLAY DRIVER COMPONENTS 
The display driver 732 may include software instructions which permit the 
computer system to communicate infonnation to the video display 547, or video 
5 adapter 740, in a way which can be interpreted by the video display 547. Although 

the display driver 732 is shown outside of the operating system block 535', the display 
driver 732 may be considered as a part of Ihe operating system 535*. As shown in 
Figure 7, the display driver 732 may include a display driver management process 735 
which can accept display information 724* and which manages a color compensation 

10 (or color filtering) process 736, a gamma correction process 737, and a color palette 

selection process 738. The display infonnation 724' may include the gamma of the 
display device 547 and flie color palette of the display device 547. 

Figure 22 is a high level flow diagram of a method 735' which may be used to 
effect the display driver management process 735. The display driver management 

15 method accepts 735' glyph(s) from the glyph cache 726 and display information from 

the display device 547 (or display information about the display device 547 from a 
system configuration file) as shown in steps 2210 and 2220. Hien, the method 735' 
may invoke a color filtering process 736, described in more detail below in § 
4.2.2.2. 1, in step 2230. The method 735' may also invoke a gamma correction process 

20 737, described in more detail in §4.2.2.2.2, in step 2240. Finally, the method 735' 

may invoke a color palette selection process 738, described in more detail below in § 

4.2.2.2.3, in step 2250. The mefliod 735' is left via RETURN node 2260. 

§4.2.2.2.1 COLOR COMPENSATION 
(FILTERING) 

25 

Although the overscaling (or oversampling) and scan conversion processes 
effectively increase the resolution of the display device in the vertical direction by 
separately considering the red 210, green 220, and blue 230 sub-pixel elements, if the 
intensity values of adjacent sub-pixels differ by too much, the resulting display may 
30 be visually aimoying to a user. The color comi)ensation (color filtering) process 736 

is used to decrease intensity differences between certain adjacent sub-pixel elements 
if the intensity differences are too large. 
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Figure 23 is a flow diagram of an exemplary method 736' which may be used 
to effect the color filtering process 736. First, as shown in step 2310, filter 
parameters are accepted. In this method 736*, two (2) filters - namely a red filter and 
a blue filter are provided. In this case, the red filter uses a threshold, a red factor, and 
5 a green factor. The blue filter uses a threshold, a green factor, a blue factor, and a red 

factor. As shown, the loop defined by steps 2320 and 2380 is run for each packed 
pixel value of a glyph being processed. Within the loop 2320-2380, normahzed red, 
green and blue intensity values are determined fi:om the packed pixel value as shown 
in step 2330. More specifically, for example, the color space 0 through 255 may be 
10 divided into equal segments based on weighted colors. Thus, for example, if there are 

five (5) red colors, the color space is divided into five (5) segments, each spaced 
255/5 apart This yields six (6) unique red colors, which are normalized to flie color 
space. Thus, normalized colors can be determined using the following expression: 

1 5 (Total Number of Colors - Desired Color Index) 

* 255 /Total Number of Colors (6) 

Then, at decision step 2340, it is determined whether flie absolute value (i.e., the 
magnitude) of the difference between the red and green intensities is greater than the 
20 red filter threshold value. If so, as shown in step 2350, the red and green intensities 

are adjusted to decrease the magnitude of the difference. For example, part of this 
step may be carried out in accordance with the following expressions: 

if (R - G) > Red Filter Threshold, then 
25 R' = R - ((R - G) * Red Filter Red Factor)/10 

G' = G + ((R - G) * Red Filter Green Factor)/10 

where R is the- original red intensity, G is the original green intensity, R' is the new 
red intensity, and G' is flie new green intensity. Processing then continues to decision 
30 step 2360. Returning to decision step 2340, if the absolute value (i.e., the magnitude) 

of the difference between the red and green intensities is not greater than tiie red filter 
dueshold, the processing continues directly to decision step 2360. 
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At decision step 2360, it is determined wheAer the absolute value (i.e., the 
magnitude) of ttie difference between the green (which may have been modified in 
step 2350) and blue intensities is greater than the blue filter threshold value. If so, as 
shown in step 2370, the green intensity (as modified in step 2350, if so modified), the 
5 blue intensity, and/or the red intensity (as modified in step 2350, if so modified) are 

modified to decrease the absolute value (i.e., the magnitude) of the difference. For 
example, part of this step may be carried out in accordance with the following 
expressions: 



10 if (G - B) > Blue Filter Threshold, then 

G' = G - ((G - B) * Blue Filter Green Factor)/10 
B' = B + ((G - B) * Blue Filter Blue Factor)/! 0 
R' = R - ((G - B) * Blue Filter Red Factor)/10 



15 where R is the original red intensity (as modified in step 2350, if so modified), G is 

the original green intensity (as modified in step 2350, if so modified), B is the 
original blue-inteaisity, R' is the new red intensity, G' is the new green intensity, and 
B* is the new blue intensity. Processing then continues to step 2380. Returning to 
decision step 2360, if the absolute value (i.e., the magnitude) of the difference 
20 between the green and blue intensities is not greater than the blue filter threshold, the 

processing continues directly to step 2380. Once all packed pixels of a glyph have 
been processed, the method 736' is left via RETURN node 2390, 
Some sample values for the filter variables are: 
Red Filter Threshold = 1 00; 
25 Red Filter Red Factor = 3; 

Red Filter Green Factor = 2; 
Blue Filter Threshold = 128; 
Blue Filter Red Factor = 2; 
Blue Filter Green Factor = 1 ; and 
30 Blue Filter Blue Factor = 3 . 

Note that although the color filtering process was shown as a part of the 
display driver 732, it could have been applied to scan converted sub-pixel element 
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intensity values before these values are combined into a packed pixel value instead. 

§ 4.2.2.2.2 GAMMA CORRECTION 
Many display devices 547 exhibit a non-linear behavior between the input 
signal and its output. More specifically, if the input signal to the display device 547 is 
5 i and the output of the display device 547 is o, the relationship between i and o 

typically may be expressed as: 

o= ci^ (7) 
where c is a constant and Y is an exponent (commonly referred to as the "gamma" of 
the device) which is typically not one (1). In LCD displays, the gamma typically less 

10 than one (1). To ensure that the perceived gray scale in an image to be rendered on 

display 547 is correct, an additional, compensating, non-linear device, typically 
referred to as a "gamma corrector", is often used. Thus, referring to step 2240 of 
Figure 22, a gamma correction process is invoked. 

Figure 24 is a high level flow diagram of an exemplary gamma correction 

15 method 2240' which may be used to effect the gamma correction process 2240. This 

method 2240' may optionally normalize intensity values to a range in which gamma 
correction is most effective. First, in optional step 2410, upper and lower "useful" 
intensity values are accepted These bounds reflect the range of intensities in which 
gamma correction is most effective. If the range of intensities is from 0 to 255, the 

20 lower bound may be 30 and the upper bound may be 250 for example. In step 2420, 

the intensity value(s) are accepted. Then, in optional step 2430, the intensity values 
are noraialized to the "useful" range of intensities. The normalization may be 
performed simply by clamping such that intensities below the lower bound are set to 
the lower bound and intensities above the upper bound are set to the upper bound. 

25 Alternatively, the normalization may be performed by shifting and clamping flie 

intensities In this alternative technique, assuming upper and lower bounds of 30 and 
250, the 0 to 255 range of intensities may be shifted up, say 15, to 15 to 270 and 
clamped such tihat intensities between 15 and 29 are clamped to 30 and such that 
intensities between 251 and 270 are clamped to 250. In another alternative, the 

30 intensities are scaled and rounded to fall within the "useful" range of intensities. In 
this case, assuming a 30 lower bound of 30 and an upper bound of 250, the 256 
possible values between 0 and 255 would be scaled (and rounded) to 221 possible 
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values between 30 and 250. Naturally, other techniques for normalizing the intensities 
to the "useful" range may be employed. In step 2440, the gamma of the device 547 is 
accepted and, in step 2450, the (normalized) intensity values are adjusted based on the 
ganuna of the device 547. The metiiod 2240' is then left via RETURN node 2460. 
5 § 4,2.2.23 COLOR PALETTE SELECTION 

Display devices typically have a palette of available colors. Thus, the color, as 
defined by the color filtered and ganmia corrected red-green-blue intensity value 
triplet, is mapped to a closest available color of the display device 547. 

As mentioned above, the display information 724* may be used to select one of 

10 the look-up tables included in the set of look up tables to be used. The look-up tables 
in the set of look-up tables are used for converting packed pixel values, used to 
represent the glyph, into processed pixel values. The processed pixel values are of a 
form, such as 8-bit R, G and B luminous intensity values for example, which are used 
by the display adapter 548* and/or display device 547. Each look-up table includes 

15 one entry for each potential packed pixel value and a corresponding output value. In 

an exemplary case of 180 possible packed pixel values, a look-up table would include 
180 packed pixel values and 180 corresponding processed (e.g., output) pixel values. 
Each output pixel value may be a pre-computed value that is generated by performing 
the implemented display driver processing operations using the packed pixel value, to 

20 which the output pixel value corresponds, as input 

By using the packed pixel values representing a glyph as indexes into the . 
look-up table, a set of processed pixel values including R, G and B luminous intensity 
values, in the form utilized by the attached display adapter or display device is 
obtained. 

25 The processed pixel values included in the look-up table may be pre- 

coinputed, that is, computed before use in the display driver 732. By pre-computing 
the processed pixel values, the need to perform gamma correction, color 
compensation and/or palette selection operations in real time during image rendering 
is avoided. 

30 An alternative method to the pixel value look-up table approach may be used^ 

Gamma correction, color compensation and/or palette selection operations may be 
performed using the packed pixel values as input to generate processed pixel values in 
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a fonnat suitable for use by the display adapter 548' and/or display 547. 

§ 4.2.2.3 DISPLAY ADAPTER 
A conventional display adapter 548* may be operated in a conventional 
manner to buffer video grams and to adapt the video frames for output to the display 
5 device 547. 

§43 CONCLUSIONS 

In view of the foregoing, the present invention disclosed techniques for 
increasing flie resolution of text rendered on a display device having sub-pixel 
el^ents, such as an RGB LCD for example, and in particular, on a display device 
10 having horizontal striping. 

The present invention disclosed techniques for appropriately adjusting metrics 
associated wifli the character outline information (such as left side bearing, advance 
width, vertical character size, etc.). 

The present invention also disclosed techniques for preventing "jumping" or 
1 5 "bouncing" baselines. 

The present invention also disclosed techniques for compressing red, green 
and blue luminous intensity values. 

The present invention also disclosed techniques for selectively filtering color 
values when the differences in the intensity of adjacent sub-pixel elements would 
20 otherwise be irritating to view. 

Finally, the present invention disclosed techniques for correcting the gamma of 
the pixel values so that the gamma of the display device is considered and so that 
intensity values of sub-pixel elements fall within a range of intensities in which 
gamma correction is more useful. 

25 
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WHAT IS CLAIMED IS: 

1. A method for enhancing the resolution of text to be rendered on a display 
device having horizontally striped sub-pixel elements, the method comprising steps 
5 of: 

a) detemiining a luminous intensity value of a first sub-pixel element 
of a pixel based on first information; and 

b) determining a luminous intensity value of a second sub-pixel 
element of the pixel based on second information, and 

10 Wherein the second information is displaced from the first 

information, and 

Wherein the first infomiation includes at least one scan 
conversion source sample and wherein the second information includes 
at least one other scan conversion source sample. 
15 2. A method for enhancing the resolution of text to be rendered on a display 

device having horizontally striped sub-pixel elements, the method comprising steps 
of: 

a) detemiining a luminous intensity value of a first sub-pixel element 
of a pixel based on first information; and 
20 b) determining a luminous intensity value of a second sub-pixel 

element of the pixel based on second information, 

wherein the second infom[iation is displaced from the first 
information, and 

wherein each of the steps of determining the luminous intensity 
25 value of the first sub-pixel element of the pixel and determming the 

luminous intensity value of flie second sub-pixel element of the pixel 
includes sub-steps of: 

i) accepting character information and display device 
resolution information; 

30 ii) accepting a resolution enhancement overscaling factor; and 

iii) scaling the character information based on tiiie display 
device resolution information and the resolution enhancement 
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overscale factor. 

3. The method of claim 2 wherein each of the steps of determining the luminous 
intensity value of the first sub-pixel element of the pixel and determining the 
luminous intensity value of the second sub-pixel element of the pixel further includes 

5 a sub-step accepting a point size, and 

wherein the sub-step of scaling the character information is further 

based on the point size. 

4. The method of claim 2 wherein the character information defines a vertical 
direction and a horizontal direction and 

10 wherein, in the sub-step of scaling the character information, the 

character information is scaled to a greater degree in a vertical direction flian 
in a horizontal direction- 
s' The method of claim 2 wherein the resolution enhancement overscaling factor 
is greater than one. 

15 6. The method of claim 2 wherein the resolution enhancement overscaling factor 

is at least three. 

7. The method of claim 2 wherein tiie resolution enhancement overscaling factor 
is sixteen; 

8. A mefliod for enhancing the resolution of text to be rendered on a display 
20 device having horizontally striped sub-pixel elements, the metfiod comprising steps 

of: 

a) determining a luminous intensity value of a first sub-pixel 
element of a pixel based on first information; and 

b) determining a luminous intensity value of a second 
25 sub-pixel element of the pixel based on second information, 

wherein the second information is displaced from flie first 
information, and 

wherein each of the steps of determining the luminous intensity 
value of the first sub-pbcel element of the pixel and determining the 
30 luminous intensity value of the second sub-pixel element of flie pixel 

includes sub-steps of: 

i) accepting character information and display 
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device resolution information; 

ii) accepting a resolution enhancement oversampling 
factor; 

iii) scaling the character information based on the 
5 display device resolution information to generate scaled 

character information; and 

iv) oversampling flie scaled character information 
based on the resolution enhancement oversampling 
factor. 

10 9. The method of claim 8 wherein each of the steps of determining the luminous 

intensity value of the first sub-pixel element of the pixel and determining the 
luminous intensity value of the second sub-pixel element of the pixel further includes 
a sub-step accepting a point size, and 

wherein the sub-step of scaling tiie character information is furflier 
1 5 based on the point size. 

10. The method of claim 8 wherein the character infomiation defines a horizontal 
direction and a vertical direction and 

wherein, in tiie sub-step of scaling the character information, the 
character information is sampled to a greater degree in a vertical direction than 
20 in a horizontal direction. 

1 1 The mefliod of claim 8 wherein the resolution enhancement oversampling 
factor is greater than one. 

12. The method of claim 8 wherein the resolution enhancement oversampling 
factor is at least three. 

25 13. The method of claim 8 wherein the resolution enhancement oversampling 

factor is sixteen. 

14. A method for enhancing the resolution of text to be rendered on a display 
device having horizontally striped sub-pixel elements, the method comprising steps 
of: 

30 a) determining a luminous intensity value of a first sub-pixel element 

of a pixel based on first information; and 

b) determining a luminous intensity value of a second sub-pixel 
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element of flie pixel based on second in formation, 

wherein the second information is displaced from the first 
information, and 

wherein each of the steps of determining the luminous intensity 
5 value of the first sub-pixel element of the pixel and determining the 

luminous intensity value of the second sub-pixel element of the pixel 
includes sub-steps of: 

i) accepting character information and display device 
resolution information; 

jQ ii) accepting a resolution enhancement overscaling 

factor; 

iii) rotating the character information to generate 
rotated character information; and 

iv) scaling the rotated character information based on 
15 the display device resolution information and the 

resolution enhancement overscale factor. 

15. The method of claim 14 wherein the sub-step of rotating the character 
information rotates the character information by 90 degrees. 

16. The method of claim 15 wherein the character information is rotated 
20 counterclockwise by 90 degrees if the display device is an RGB display device. 

17. The method of claim 15 wherein the character information is rotated 
clockwise by 90 degrees if the display device is a BGR display device. 

18. The metiiod of claim 14 wherein the resolution enhancement overscale factor 
is greater than one. 

25 19. The method of claim 14 wherein the resolution enhancement overscale factor 

is at least three. 

20. The method of claim 14 wherein the resolution enhancement overscale factor 
is sixteen. 

21. A mefliod for enhancing the resolution of text to be rendered on a display 
30 device having horizontally striped sub-pixel elements, the method comprismg steps 

of: 

a) determining a lunrnious-intensity value of a first sub-pixel 
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element of a pixel based on first information; and 

b) determining a luminous intensity value of a second sub-pixel 
element of the pixel based on second information, 

wherein the second information is displaced from the 
5 first information, and 

wherein each of the steps of determining the luminous 
intensity value of the first sub-pixel element of flie pixel and 
determining the luminous intensity value of the second sub- 
pixel element of the pixel includes sub-steps of: 
10 i) accepting character Information and display device 

resolution information; 

ii) accepting a resolution ^ihancement oversampling 

factor; 

iii) rotating the character information to generate 
15 rotated character information; 

iv) scaling the rotated character information based on 
the display device resolution information to generate 
scaled character information; and 

v) oversampling the scaled character information based 
20 on the resolution enhancement oversampling factor. 

22. The method of claim 21 wherein each of the steps of determining the luminous 
intensity value of the first sub-phcel elemmt of the pixel and determining the 
luminous intensity value of the second sub-pixel element of the pixel further includes 
sub-step accepting a point size and wherein the sub-step of scaling the rotated 

25 character infomiation is farther based on the point size. 

23. The method of claim 21 wherein the sub-step of rotating the character 
information rotates the character information by 90 degrees. 

24. The method of claim 23 wherein the character information is rotated 
counterclockwise by 90 degrees if the display device is an RGB display device. 

30 25. The method of claim 23 wherein the character information is rotated 

clockwise by 90 degrees if the display device is a BGR display device. 
26. The method of claim 21 wherein the resolution enhancement oversample 



wo 02/01546 PCT/USOO/17524 



-48- 

factor is greater than one. 

27. The method of claim 21 wherein the resolution enhancement oversample 
factor is at least three. 

28. The method of claim 21 wherein the resolution enhancement oversample 

5 factor is sixteen. 

29. A machine readable medium having machine readable instructions which, 
when executed by a machine, perform a method for enhancing the resolution of text to 
be rendered on a display device having horizontally strq)ed sub-pixel elements, the 
method conq)rising steps of: 

10 a) determining a luminous intensity value of a first sub pixel element 

of a pixel based on first information; and 

b) determining a luminous intensity value of a second sub- pixel 
element of tiie pixel based on second information, 

wherein the second information is displaced firom the first 
1 5 information, and 

wherein each of flie steps of determining flie luminous intensity 
value of the first sub-pixel element of the pixel and determining the 
luminous intensity value of the second sub-pixel element of the pixel 
includes sub-steps of: 

20 i) accepting character information and display 

device resolution information; 

ii) accepting a resolution enhancement overscaling 
factor, 

iii) rotating the character information to generate 
25 rotated character information; and 

iv) scaling the rotated character information based 
on the display device resolution information and the 
resolution enhancement overscale factor. 

30. A machine readable medium having machine readable instructions which, 
30 when executed by a machine, perforai a method for enhancing the resolution of text to 

be rendered on a display device having horizontally striped sub-pixel elements, the 
method comprising steps of: 
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a) determining a luminous intensity value of a first sub-pixel element 
of a pixel based on first information; and 

b) determining a luminous intensity value of a second sub-pixel 
element of the pixel based on second information, 

5 wherein the second information is displaced from the first 

information; and 

wherein each of the st^s of detennining the luminous intensity 
value of the first sub-pixel element of the pixel and determining the 
luminous intensity value of the second sub-pixel element of the pixel 
10 includes sub-steps of: 

i) accepting character information and display device 
resolution information; 

ii) accepting a resolution enhancement oversampling 
factor; 

15 iii) rotating the character information to generate 

rotated character information; 

iv) scaling the rotated character information based on 
the display device resolution information to generate 
scaled character information; and 
20 v) oversampling the scaled character information based 

on the resolution enhancement oversampling factor. 
31. An apparatus for use in a system for increasing the resolution of text to be 
rendered on a display device having horizontally striped sub-pixel elements, the 
apparatus comprising: 

25 a) an input for accepting character information, display device 

resolution information and a resolution enhancement overscaling factor; and 

b) means for scaling the character information based on the display 
device resolution information and the resolution enhancement 
overscale factor. 

30 32. The apparatus of claim 3 1 wherein the input further accepts a point size, and 

wherein the means for scaling the character information scale the character 
information further based on the point size. 
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BS. The apparatus of claim 31 wherein the character information accepted by the 
input defines a vertical direction and a horizontal direction and wherein the means for 
scaling the character information scale the character information to a greater degree in 
a vertical direction than in a horizontal direction 
5 34. The apparatus of claim 31 wherein the resolution enhancement overscaling 

factor is greater than one. 

35. The apparatus of claim 31 wherein the resolution enhancement overscaling 
factor is at least three. 

36. The apparatus of claim 31 wherein the resolution enhancement overscaling 
10 factor is sixteen. 

37. An apparatus for use in a system for increasing the resolution of text to be 
rendered on a display device having horizontally striped sub-pbcel elements, flie 
ai}paratus comprising: 

a) an input for accepting character information, display device 
1 5 resolution information and a resolution enhancement oversampling factor; 

b) means for scaling the character information based on the display 
device resolution information to generate scaled character information; and . 

c) means for overscaling the scaled character information based on the 
resolution enhancement oversampling factor. 

20 3 8. The apparatus of claim 37 wherein the input further accepts a point size, and 

wherein the means for scaling the character information scales the character 
information further based on the point size. 

39. The apparatus of claim 38 wherein the character information defines a 
horizontal direction and a vertical direction and wherein the means for scaling the 

25 character information samples the character information to a greater degree in a 

vertical direction than in a horizontal direction. 

40. The apparatus of claim 37 wherein the resolution enhancement oversampling 
factor is greater than one. 

41. The apparatus of claim 37 wherein ihe resolution enhancement oversampling 
30 factor is at least three. 

42. The apparatus of claim 37 wherein ihc resolution enhancement oversampling 

factor is sixteen. 



BNSDOCID: <WO 0201546A1J_> 



wo 02/01546 PCT/USOO/17524 



-51- 

43. An apparatus for use in system for increasing the resolution of text to be 
rendered on a display device having horizontally striped sub-pixel elements, tihe 
apparatus comprising: 

a) an input for accepting a character information, display device 
5 resolution information and a resolution enhancement overscaling factor; 

b) means for rotating the character information to generate rotated 
character information; and 

c) means for scaling the rotated character information based on the 
display device resolution information and the resolution enhancement 

1 0 overscale factor. 

44. The apparatus of claim 43 wherein flie means for rotating the character 
information rotates the character information by 90 degrees. 

45. The apparatus of claim 43 wherein the means for rotating the character 
information rotates the chamcter information counterclockwise by 90 degrees if the 

1 5 display device is an RGB display device. 

46. The apparatus of claim 43 wherein the means for rotating the character 
information rotates the character information clockwise by 90 degrees if the display 
device is a BGR display device. 

47. The apparatus of claim 43 wherein the resolution enhancement factor is 
20 greater than one. 

48. The apparatus of claim 43 wherein the resolution enhancement factor is at 
least three. 

49. The apparatus of claim 43 wherein the resolution enhancement factor is 
sixteen. 

25 50. An apparatus for use in a system for increasing the resolution of text to be 

rendered on a display device having horizontally striped sub-pixel elements, the 
apparatus comprising: 

a) an input for accepting character information, display device 
resolution information and a resolution enhancement oversampling factor; 
30 b) means for rotating the character information to generate rotated 

character information; 

c) means for scaling the rotated character information based on the 
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display device resolution infonnation to generate scaled character information; 
and 

d) means for oversampling the scaled character infonnation based on 
the resolution enhancement oversampling factor. 
5 51 . The apparatus of claim 50 wherein the input further accepts a point size, and 

wherein the means for scaling the character information scales the 
character information further based on the point size. 

52. The apparatus of claim 50 wherein the means for rotating the character 
information rotates the character information by 90 degrees. 
10 53. The apparatus of claim 51 wherein fte means for rotating the character 
information rotates the character information counterclockwise by 90 degrees if the 
display device is an RGB display device. 

54. The apparatus of claim 51 wherein the means for rotating the character 
information rotates the character information clockwise by 90 degrees if the display 

1 5 device is a BGR display device. 

55. A machine readable medium for use in a system for enhancing the resolution 
of text to be rendered on a display having horizontally striped sub-pixel elements,, the 
machine readable medium having stored thereon a data structure, the data structure 
comprising scaled character information, wherein the scaled character information is 

20 scaled to a greater extent in a vertical direction than in a horizontal direction. 

56. A machine readable mediimi for use in a system for enhancing flie resolution 
of text to be rendered on a display having horizontally striped sub-pixel elements, the 
machine readable medium having stored thereon a data structure, the data structure 
comprising scaled rotated character information, wherein the scaled rotated character 

25 information is scaled to a greater extent in a horizontal direction than in a vertical 
direction. 

57. A mettiod for enhancing the resolution of text to be rendered on a display 
device having horizontally striped sub-pixel elements, the method comprising steps 
of: 

30 a) determining a luminous intensity value of a first sub-pixel element 

of a pixel based on first information; and 

b) determining a luminous intensity value of a second sub-pixel 
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element of the pixel based on second infonnation, 

wherein the second information is displaced from the JBrst 
information, and 

wherein each of tiie steps of determining the luminous intensity 
5 value of the first sub-pixel element of the pixel and determining the 

luminous intensity value of the second sub-pixel element of the pixel 
includes sub-steps of: 

i) accepting character information and display device 
resolution information; 

10 ii) accepting a resolution enhancement overscaling 

factor; 

iii) scaling the character information based on the 
display device resolution information and Ae resolution 
enhancement overscale factor to generate scaled 

15 character information; and 

iv) rotating the scaled character information. 

58. A me&od for enhancing the resolution of text to be rendered on a display 
device having horizontally striped sub-pixel elements, the method comprising steps 
of: 

20 a) determining a luminous intensity velxxe of a first sub-pixel 

element of a pixel based on first information; and 

b) determining a luminous intensity value of a second sub-pixel 
element of the pixel based on second information, 

wherein the second information is displaced from the first 
25 information, and 

wherein each of the steps of determining the luminous intensity 
value of the first sub-pixel element of the pixel and determining the 
luminous intensity value of the second sub-pixel element of the pixel 
includes sub-steps of: 

30 i) accepting character information and display device 

resolution information; 

ii) accepting a resolution enhancement oversampling 



BNSDOCID:<WO 0201546A1 I > 



wo 02/01546 PCT/USOO/17524 



-54- 

factor; 

iii) scaling the character information based on 
the display device resolution information to generate 
scaled character information; and 
5 iv) oversampling the scaled character information 

based on the resolution enhancement oversampling 
factor to generate oversampled character information; 
and 

v) rotating the oversampled character information. 
10 59. An apparatus for use in a system for increasing the resolution of text to be 

rendered on a display device having horizontally striped sub-pixel elements, the 
apparatus comprising: 

a) an input for accepting a character information, display device 
resolution information and a resolution enhancement overscaling factor; 
15 b) means for scaling the character information based on the display 

device resolution information and the resolution enhancement overscale factor 
to generate scaled character information; and 

c) means for rotating the scaled character information. 
60. An apparatus for use in a system for increasing the resolution of text to be 
20 rendered on a display device having horizontally striped sub-pixel elements, the 

apparatus comprising: 

a) an input for accepting character information, display device 
resolution information and a resolution enhancement oversampling factor; 

b) means for scaling the character information based on the display 
25 device resolution information to generate scaled character information; 

c) means for oversampling the scaled character information based 
on the resolution enhancement oversampling factor to generate oversampled 
character information; and 

d) means for rotating the oversampled character information. 
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